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DETAILED ACTION 

1 . This Office action is responsive to the Request for Continued Examination (RCE) 
filed under 37 CFR §1 .53(d) for the instant application on 04/1 0/08. Applicants have 
properly set forth the RCE, which has been entered into the application, and an 
examination on the merits follows herewith. 

2. Claims 6-36 are pending. 

Claim Rejections - 35 USC § 102 

3. The following is a quotation of the appropriate paragraphs of 35 U.S.C. 1 02 that 
form the basis for the rejections under this section made in this Office action: 

A person shall be entitled to a patent unless - 

(e) the invention was described in (1) an application for patent, published under section 122(b), by 
another filed in the United States before the invention by the applicant for patent or (2) a patent 
granted on an application for patent by another filed in the United States before the invention by the 
applicant for patent, except that an international application filed under the treaty defined in section 
351 (a) shall have the effects for purposes of this subsection of an application filed in the United States 
only if the international application designated the United States and was published under Article 21 (2) 
of such treaty in the English language. 

4. Claims 6-7, 17-18, 25-26, and 35-36 are rejected under 35 U.S.C. 102(e) as 
being anticipated by Hui et al (hereinafter "Hui", US 6,237,010). 

Regarding claims 6 and 25, Hui teaches a method and an apparatus for creating 
a representation, comprising capturing an image of a first object the first object 
associated with a first software application (capturing objects to create images and 
thumbnail versions by using the first software application) (col. 6, lines 46-53); 
determining a reference to the first object (each thumbnail/image has a filename, col. 7, 
lines 12-18, Fig. 6-8); creating a second object associated with a second software 
application and an image of the second object (using a second software application to 
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create audio files) (associating selected audio file displayed in window 144), the second 
software application being distinct from the first software application (col. 15, lines 32- 
67); creating a reference marker, the reference marker graphically connecting the image 
of the second object with the image of the first object (reference marker connects the 
image/thumbnail to its associated audio file) (col. 16, lines 1-6) (Hui teaches associating 
(connecting/referencing) image 107 and audio file in Fig. 18. Hui further teaches that the 
audio file for image 107 can be selected in window 144. By highlighting the selected 
audio file (in window 144), Hui teaches that the reference marker graphically connects 
the image of the second object (audio file) with the image of the first object (image 107) 
(see Fig. 18, col. 15, lines 32-45) (also see audio icon); creating the representation, the 
representation comprising the captured image, the determined reference, the image of 
the second object, and the reference marker; and adding the representation to a 
message (representation comprising the image/thumbnail, its associated filename, and 
its associated audio file) (the representation is added to a webpage having its 
associated URL) (line 65 of col. 17 to line 32 of col. 18) (Fig. 21, 24-25). 

Regarding claims 7 and 26, Hui teaches claims 6 and 25, wherein the first object 
is displayed in the first software application and wherein capturing the image of the first 
object comprises capturing the image of the first object as displayed in the first software 
application (col. 6, lines 46-53). 

Regarding claims 17 and 35, Hui teaches claims 6 and 25, further comprising 
storing the first object in a memory and wherein determining the reference to the first 
object comprises producing a pointer to the first object in the memory (col. 7, lines 12- 
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18, Fig. 6-8) 

Regarding claims 18 and 36, Hui teaches claims 6 and 25, further comprising 
prior to capturing the image of the first object, receiving an input from a user, the input 
selecting the first object (col. 6, lines 46-53) (col. 7, lines 12-18, Fig. 6-8). 

Claim Rejections - 35 USC § 103 

5. The following is a quotation of 35 U.S.C. 1 03(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

6. Claims 8, 10, 12, 14-16, 27, 29, 30, and 32-34 are rejected under 35 U.S.C. 
103(a) as being unpatentable over Hui and Chailleux (US 6,404,441). 

Regarding claims 8 and 27, Hui teaches claims 7 and 26 but does not teach 
wherein capturing the image of the first object as displayed in the first software 
application comprises capturing a screen shot of the first object as displayed in the first 
software application. Chailleux teaches capturing screen shot of displayed screens and 
displayed captured screen shots as reduced images (col. 9, lines 9-24, Fig. 6). It would 
have been obvious to one of ordinary skill in the art, having the teaching of Hui and 
Chailleux before him at the time the invention was made, to modify the capturing system 
taught by Hui to include capturing screen shot taught by Chailleux with the motivation 
being to enable Hui's system to embed different types of images in a web page. 

Regarding claims 10 and 29, Hui teaches claims 6 and 25 but does not teach 
wherein the first object represents a plurality of images and wherein capturing the image 
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of the first object comprises capturing one of the plurality of images represented by the 
first object. Chailleux teaches capturing the image of the first object comprises capturing 
one of the plurality of images represented by the first object (capturing screen shot of 
displayed screens and displayed captured screen shots as reduced images, col. 9, lines 
9-24, Fig. 6). It would have been obvious to one of ordinary skill in the art, having the 
teaching of Hui and Chailleux before him at the time the invention was made, to modify 
the capturing system taught by Hui to include capturing screen shot taught by Chailleux 
with the motivation being to enable Hui's system to embed different types of images in a 
web page. 

Regarding claims 12 and 30, Hui teaches claims 6 and 25 but does not teach 
wherein the first object represents a web page and wherein determining the reference to 
the first object comprises determining a Uniform Resource Locator (URL) of the web 
page. Chailleux teaches capturing a web page (col. 12, lines 30-47). It would have been 
obvious to one of ordinary skill in the art, having the teaching of Hui and Chailleux 
before him at the time the invention was made, to modify the capturing system taught by 
Hui to include capturing web page taught by Chailleux with the motivation being to 
enable Hui's system to embed different types of images in a web page. 

Regarding claims 14, 16, 32, and 34, Hui teaches claims 6 and 25, but does not 
teach wherein the first object comprises a hypertext link and wherein capturing an 
image of the first object comprises capturing an image of a web page corresponding to 
the hypertext link. Chailleux teaches capturing a web page displayed in a web browser 
(col. 12, lines 30-47). It would have been obvious to one of ordinary skill in the art, 
having the teaching of Hui and Chailleux before him at the time the invention was made, 
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to modify the capturing system taught by Hui to include capturing web page taught by 
Chailleux with the motivation being to enable Hui's system to embed different types of 
images in a web page. 

Regarding claims 15 and 33, Hui, as modified by Chailleux teaches storing the 
web page in a memory (Chailleux, col. 9, lines 8-17). 

7. Claims 1 9-20 are rejected under 35 U.S.C. 1 03(a) as being unpatentable over 
Hui and Anguilo et al (hereinafter "Anguilo", US 6275839) 

Regarding claim 19, Hui teaches associating the first object and the second 
object (col. 16, lines 1-16) but fails to teach displaying the first object in response to 
user selecting the second object. Anguilo teaches the method of claim 6, further 
comprising: receiving an input from a user, the input selecting the second object; and 
responsive to having received the input, displaying the first object (col. 12, lines 19-38). 
It would have been obvious to one of ordinary skill in the art, having the teaching of Hui 
and Anguilo before him at the time the invention was made, to modify the capturing 
system taught by Hui to include Anguilo teaching with the motivation being to 
conveniently and quickly access associated objects. 

Regarding claim 20, Hui teaches the method of claim 18, but fails to teach that 
the first object comprises a hypertext link. Anguilo teaches the first object comprises a 
hypertext link and wherein displaying the first object comprises: determining whether a 
web page corresponding to the hypertext link is accessible; responsive to having 
determined that the web page is accessible, presenting the web page; and responsive 
to having determined that the web page is not accessible, presenting a web page that 
corresponds to the hypertext link and is stored in memory (line 61 of col. 5 to line 9 of 
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col. 6). It would have been obvious to one of ordinary skill in the art, having the teaching 
of Hui and Anguilo before him at the time the invention was made, to include Anguilo's 
teaching in the capturing system taught by Hui with the motivation being to enable Hui's 
system to embed different types of images in a web page. 

8. Claims 9 and 28 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Hui and Jungleib (US 5,886,274) 

Regarding claims 9 and 28, Hui teaches claims 6 and 25 but does not teach 
wherein the first object represents a sound and wherein capturing the image of the first 
object comprises generating a waveform for the sound represented by the first object. 
Jungleib teaches a sound editor for generating a waveform for the sound represented 
by the first object (col. 5, lines 38-41 , Fig. 4b). It would have been obvious to one of 
ordinary skill in the art, having the teaching of Hui and Jungleib before him at the time 
the invention was made, to modify the capturing system taught by Hui to include 
generating a waveform of a sound taught by Jungleib with the motivation being to 
enable Hui's system to embed different types of objects in a web page. 

9. Claims 11 is rejected under 35 U.S.C. 103(a) as being unpatentable over 
Hui, Chailleux, and Jungleib. 

Regarding claim 1 1 , Hui and Chailleux teach the method of claim 1 0 but do not 
teach wherein the first object represents a sound. Jungleib teaches a sound editor for 
generating a waveform for the sound represented by the first object (col. 5, lines 38-41 , 
Fig. 4b). It would have been obvious to one of ordinary skill in the art, having the 
teaching of Hui, Chailleux, and Jungleib before him at the time the invention was made, 
to modify the capturing system taught by Hui to include generating a waveform of a 
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sound taught by Jungleib with the motivation being to enable Hui's system to embed 
different types of objects in a web page. 

10. Claims 13, 21-24, and 31 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Hui and Treibitz (US 6,091 ,408). 

Regarding claims 13 and 31, Hui teaches claims 6 and 35, but does not teach 
wherein the first object represents a second message and wherein determining the 
reference to the first object comprises determining a pointer to the second message in a 
messaging system. Treibitz teaches wherein the first object represents a message and 
wherein determining the reference to the first object comprises determining a pointer to 
the message in a messaging system (col. 5 lines 33-47). It would have been obvious to 
one of ordinary skill in the art, having the teaching of Hui and Treibitz before him at the 
time the invention was made, to modify the capturing system taught by Hui to include 
capturing message taught by Treibitz with the motivation being to enable Hui's system 
to embed different types of objects in a web page. 

Regarding claim 21 , Hui does not teach updating the second object. Treibitz 
teaches updating the second object (window in the second display, col. 2, line 67 to col. 
3, lines 14). It would have been obvious to one of ordinary skill in the art, having the 
teaching of Hui and Treibitz before him at the time the invention was made, to modify 
the capturing system taught by Hui to include updating the second object taught by 
Treibitz with the motivation being to provide Hui's system with the ability to modify the 
second object. 
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Regarding claim 22, Hui, as modified by Treibitz, teaches the method of claim 21, 
wherein updating the second object comprises: capturing a new image of the first 
object; and replacing, within the second object, the image with the new image (Treibitz, 
col. 3, lines 4-15). 

Regarding claim 23, Hui, as modified by Treibitz, teaches the method of claim 21 , 
wherein updating the second object comprises: determining a new reference to the first 
object; and replacing, within the second object, the reference with the new reference 
(Treibitz, col. 3, lines 4-15). 

Regarding claim 24, Hui, as modified by Treibitz, teaches the method of claim 21 , 
wherein updating the second object comprises: determining whether the first object has 
changed; and responsive to having determined that the first object has changed, 
updating the second object (Treibitz, col. 3, lines 4-15). 

1 1 . Applicant's arguments filed on 04/10/08 have been considered but they are not 
persuasive. 

Applicant argues: 

"Hui fails to disclose or suggest at least the feature of'creating a reference marker, the 
reference marker graphically connecting the image of the second object with the image of the 
first object." 

Examiner respectfully disagrees. Hui teaches associating 
(connecting/referencing) image 107 and audio file in Fig. 18. Hui further teaches that the 
audio file for image 107 can be selected in window 144. By highlighting the selected 
audio file (in window 144), Hui teaches that the reference marker graphically connects 
the image of the second object (audio file) with the image of the first object (image 1 07) 
(see Fig. 18, col. 15, lines 32-45). 
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12. Any inquiry concerning this communication or earlier communications from 
the examiner should be directed to Kieu D. Vu. The examiner can normally be reached 
on Mon - Thu from 7:00AM to 3:00PM at 571-272-4057. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, William Bashore, can be reached at 571-272-4088. 

The fax phone numbers for the organization where this application or proceeding 
is assigned are as follows: 

571-273-8300 

and / or: 

571-273-4057 (use this FAX #, only after approval by Examiner, for "INFORMAL" 
or "DRAFT" communication. Examiners may request that a formal paper / amendment 
be faxed directly to them on occasions). 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). 

/Kieu D Vu/ 

Primary Examiner, Art Unit 2175 



